Pytorch-nn.functional.ReLU()
测试代码:
import torch
import torch.nn as nn
m = nn.ReLU(inplace=True)
input = torch.randn(10)
print(input)
output = m(input)
print(output)
print(input)
输出为:
tensor([ 0.2837, -1.2100, -0.4476, 1.0861, 2.2029, -0.3802, -0.0020, 1.8135, 0.5749, 0.5932])
tensor([0.2837, 0.0000, 0.0000, 1.0861, 2.2029, 0.0000, 0.0000, 1.8135, 0.5749, 0.5932])
tensor([0.2837, 0.0000, 0.0000, 1.0861, 2.2029, 0.0000, 0.0000, 1.8135, 0.5749, 0.5932])
结论:
nn.ReLU(inplace=True)
inplace=True会改变输入数据,inplace=False不会改变输入数据